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FIG. 2A 
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FIG. 2B 
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FIG. 3A 
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( «Ri IMAGE DISPLAY PROCESSING ) 
^100 




[n-is APPLICATION OF 



INDICATE "MEASURING STATE* 



ilVE mm INSTRUCTION TO A 
3-D SHAPE IEASUREHENT DEVICE AND filVE 
JHAGfNS INSTRUCTION TO A VIDEO CAMERA 




FETCH Ifl SURFACE MEASUREMENT 
DATA AND PICKUP IMAGES 



112 



EXTRACT 3-D COORDINATES OF PREOPERATIVE 
HARKS AND INTRAOPERATIVE MARKS FROM 
SURFACE MEASUREMENT DATA 



BASED ON THE POSITIONAL RELATIONSHIP 
BETE PREOPERATIVE HARKS AND INTRAOPERATIVE 
MARKS'. DERIVE AND STORE COORDINATE CONVERSION 
EXPRESSION FOR CONVERTING BOX-TYPE COORDINATE 
SYSTEM TO HRI COORDINATE SYSTEM WITH 
INTRAOPERATIVE HARKS SERVING AS REFERENCE 



| READ AND DISPLAY MR I IAMGES 

M16 




INDICATE "MEASURING STATE" 



GIVE MEASUREMENT INSTRUCTION TO A 3^ 
SHAPE MEASUREMENT DEVICE AND GIVE 
IMAGING INSTRUCTION TO A VIDEO CAMERA 



FETCH IN SURFACE MEASUREMENT DATA AND PICKUP IMAGES 



EXTRACT 3-D COORDINATES OF INTRAOPERATIVE 
» FROM SURFACE MEASUREMENT DATA 



BASED Oil 3-D COORDINATES OF INTRAOPERATIVE \ 
AND COORDINATE CONVERSION EXPRESSION, CONVbx. r u 
COORDINATES OF EACH POINT ON A BRAIN SURFACE f 
REPRESENTED BY SURFACE MEASUREMENT DATA TO 3-D 
COORDINATES IN MR I COORDINATE SYSTEM 



1 , r 132 

REQUEST OF ULTRASONIC TOMOGRAPHY AND GIVE MEASUREMENT H 
INSTRUCTION TO 3-D SHAPE MEASUREMENT DEVICE 



FETCH III ULTRASONIC TOMFHIC IMAGE AND SURFACE IIEAHENT DATA I 



EXTRACT PROBE POSITION AND 3-D COORDINATES OF 
INTRAOPERATIVE MARKS FROM SURFACE MEASUREMENT DATA 



EXTRACT FEATURE POINTS CORRESPONDING TO UNEXPOSED 
PORTION OF THE BRAIN FROM ULTRASONIC TOMOGRAPHIC IMAGE 



BASED OH PROBE POSITION. 3-D COORDINATES OF INTRAOPERATIVE 
MARKS AND Ml NATE WERSION EXPRESSION, CALCULATE 3-0 
COuRDlMTES OF EACH FEATURE POINT IN Mill COORDINATE SYSTEM 



FETCH IN 3-D BRAIN MODEL 



BASED ON 3-0 COORDINATES OF EACH POINT ON A BRAIN 
SURFACE, 3-D (MORDINATES OF EACH FEATURE POINT 
CORRFSPOMOING TO AN UNEXPOSED PORTION OF THE BRAIN, 
AND P I GKUP IAJIGE. CORRECT THE POSITION OF NODE POINT 
"MSPOflDIIIG Ti 3-D BRAIN MODEL 



AMONG 3-D MODELS, ESTIMATE AND CALCULATE THE 
POSITION OF NODE POINT WHOSE POSITION IS NOT 
CONNECTED, USING FINITE ELEMENT METHOD 



CORRECT MR I IMAGES BASED ON 3-D BRAIN MODELS AFTER 
CORRECTION OF POSITION OF EACH NODE POINT 



DISPLAY MRI IMAGES AFTER CORRECTION 
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FIG. 6A 




FIG. 6C 
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